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ABSTRACT 


Conceptually, the current use of computers has taken two forms in 
the teaching of elementary statistics: ,integrating the content of statistics 
with that of computers; and integrating methods of instruction.of statistics 


by -use of computers. 
language textbooks are reviewed. 
presenting programming problems. 


‘In the first half of this paper, three computer » 
Each uses statistics as a content area 
Also, three textbooks which focus on 


learning statistics using the computer as an aide are reviewed. The second 
half of this. paper surveys six published articles that evaluate courses 
employing "hands-on" computer instruction (CAl1) and also, many published 
articles evaluating ‘courses employing a demonstrational mode of instruction. 
The generation and use of simulated experimental data and interactive vs. 
non-interactive computerized statistical packages are reviewed. Extensive 
recommendations for integrating computers into the teaching of statistics 


_are included. 


. * 
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he Current Use of Computers in the: 
a : 


Teaching of Statistics 

Within the last five years a cates has occurred in all courses 
that require calculations. From primary grades to post-doctoral study, 
the inexpensive electronic pocket calculator has had a pervasive impact 
upon the curricula. But, just as the introduction of calculators in 
courses of statistics greatly influenced the development of the analysis 
of variance and experimental design (Evans, 1973), so too can we expect 
the introduction of daexpensive, programmable computers to have a greater 
influence on the development of statistical theory, practice, and teaching. 

The impact of conputers on statistical theory is best exemplified 
by the recent work on matrix decompositions, generalized inverses, and 
oe analysis (Golub, 1969; Rao, 1966; Kshirsagar, 1972). Many 
of the classical, hand-calculator based methods have now become obsolete 
or have been revised with the advent of computers (Golub, 1969). The 
computer has already danced statistical practice. Extensive plotting 
of data and residuals is quite common. There hae been a shift of emphasis 
from general tables of statistical functions, to direct evaluation of 


' reported in research 


discrete values. It is unusual not to see "p-values' 
articles. Whereas, ten years ago ".05", ".01",: and "ns" were commonplace. 
Jack-knifing is an example of a statistical technique whose widespread 
application would not have been seriously considered before the sven of 
computers, but it is now included in the.curriculum. Evans (1973) gives 


an excellent review of the infiuence of computers-on modern Statistics. _ 


Yet, for all the impact computers have had on the theory and practice 


of statistics, only recently have there been attempts to integrate the 

use of computers with the teaching of elementary statistics. The purpose 
of this article is to explore the current use of computers in the teaching 
of elementary statistics. Conceptually, this exploration will be in two 
forms. First, the various means of integrating computers into the content 
of elementary statistics will be examined. Criteria for identifying the 
strengths and weaknesses of published textbooks and edectuvieds statisti- 
cal packages will be examined from the viewpoint of content relevance. 
Second, the various methods of implementing the inteuratad content of 
statistics and computerized statistical packages will be surveyed. 
Although the principal emphasis is on an introductory noa-calculus 


course, most of the methods described in the second part of this paper 


are uscful in higher level courses in statistics and research methodology. 


Integrating the Content of Statistics and Computers 


Recent introductory textbooks attempting to integrate statistics 


with computers appear to take two forms. In the first form, the object 


is to learn a computer language, where statistics is used as a content 


area presenting program problems. The second form that many recent intro- 


ductory statistical textbooks have attempted, focuses on learning 


statistics using the computer as an aide. In these textbooks, a higher 


order computer language or a "canned" statistical package is used as a 
vehicle facilitating rapid computation and/or insight of statistical 


texts and procedures. 


Introductory Computer Programming Textbooks with Statistics 


Three introductory programming textbooks using statistics as a 
vehicle for teaching FORTRAN are: Tntroductory Statistics with FORTRAN 
by Kirch (1973) reviewed by McCabe (1974); FORTRAN Programming for the 


Behavioral 


Scienges by Veldman (1967); and Introduction to Statistics 
and Computer Programming by Kossack and Henschke (1975). All three of 
the textbooks attempt to complement and enhance statistical development. 
However, each of the three textbooks overwhelming emphasize the learning 
of FORTRAN at the expense of the statistical content. Each of the texts 
orderly organizes the introduction of FORTRAN from I/0 media to program 
libraries, from simple FORTRAN statements to branching, and from sinpie 
manipulation of constants to complex operations oe arrays. The 


incorporation of previous statistical exercise programs as subroutines 


of subsequent statistical programs.is common to all three texts. Such 


exercises provide a sense of scgapplishnent and utility in progranming. 
4 


In reality, statistical programs are built from repetitive, meaningful 
; VA ; . 
components much in the same way at a statistician's repertoire of 


designs and analyses originatgs. However, it is questionable whether 


. 


the content of such texts should be used in introductory statistics 


courses. Such texts would better serve the tedching of computer 
languages. On tne other hand, perhaps an exciting use of these texts 
‘ : 
would be as a language option for terminal degrees in the behavioral 
sciences. 
All too often, when computer applications enter the behavioral 


. “y 
research process, it is via a computer programmer ‘and perhaps a 


5) 


a consulting statistician. This mode of adaptation encourages the 
behavioral researcher to relate to the programmer and statistician as 
one might relate to & vending machine or a taxi @ab. That is, when 
a researcher cxcludes knowledge of a computer language from his own 
skills, he leaves a critical part of his research in the hands of . 
' ° 
another (Erickson & Jacobsen, 1973). Furthermore, he has no iene of 
determining whether or not the computer analysisewas accurate or not, 


nor,whether its expense was justifiable. In short, a course froma 


S ‘ 


computer/statistics textbook could be taught in such a way as to deepen 
the student's understanding of various statistics and the theory behind 


them-rather than teaching that the computer is just another type of 


desk calculator. 


13 
Following are reasons for using a ¢ommon language like FORTRAN 


in teaching statistics (Andrews, 1973): 
1. Programmer is aware of the strengths and weaknesses of numerical 


algorithms. . . - 


» 53 5 
Programmer has control over input/output and calculations. 


Greater efficiency and fiexibility in hand4ing ‘data and core 


allocation. * + : ; : ‘ 
‘ ’ - . 
The higher the language level, the more severe the constraints 


e 


,on input/output (1/0). 
e 


. 


Following are reasons for not using a common Janguage like FORTRAN 


in teaching statistics: : i 4 . 
1. Excessive use of clasg time to learn FORTRAN. ,. 


, 
a . . . 


2. Time that could be used én theory is squandered explaining 


tedious Programming problegs. 


* § 


ba ’ 


3. Rarely will a student program be correct in less than ten runs. 


A very expensive exercise. : 
3 . 


Introductory Statistical Textbooks with Computer Applications 


A classic in tae field is-Lohnes and Cooley‘s (1968) Intreduction * ‘ 

to Statistical Procedures with Goeriskete Exercises. In general though, ~ 

the content of Lohnes and Cooley's text is too advanced for an intakes 
° 

statistics course. An elementary supplement that follows in the: tradition 

of Lohnes eid ecokade is A Computer-assisted Approach to Elementary 

Statistics: Examples and Problems by Bulgren (1971). The book can.be—- 

used as a supplement to introductory statistical texts written by Adler 

and Roessler (1968), Freund (1967), Hoel (1966), Huntsberger (1967), 

or Mendenhall (1971). The strong point of Bulgren's supplement is the 

insight a student can gain through the etfulating and manipulative 

capabilfties of the computer. The book consists of-exercises to be 

solved by either writing FORTRAN programs or punching the programs in 


the appendices. Each exercise consists of the’ fo lowing four parts: 


statement of the problem, input, output, and distussion and questions. 


‘ 


‘The intuition that a student can gain ‘is exemplified by the chapter 


dealing with statistical inference- large sample methods. An exercise 

in‘that chapter compares and contrasts the 5% and 1% confidence interval 
of when @ is known verses unknown for a sample of 10.as compared to 40 
a eee computer generated N(10,100) observations. This experi- 


ment is repeated 100 times. The purpose of the exercise is threefold. 


' 


- First,the exercise is to show that in repeated sampling, the estimate of 


the population mean will fall in 95% of the 5% confidence intervals. 


re 


( 


Second, wken the population variance is unknown and when the sample size 
: & 


is large, the experimenter can rely, heavily on the degree of probability 


(confidence coefficient) established prior to running the experiment. 


Third, as the Sanpee size increases cai the experiment, the better are 


2 


% 


the point estimates x and s 


s 


aE geen rt A complete statement of the 


y « 


prctihaih input, output, and discussion and questions may be found in 


’ : , a 
Appendix A. 2 . er 
The overlaying of Bulgren's supplement on-an elementary text would 
be a compromise between the strict computer programming texts on statistics r] 


P ~ 


and the following texts. -Each of the folYewing textbooks use statistical 


packages or simple "éanned" subroutines: Introduction to Statistics and ~ 


& 
Data Analysis with Cg, ater Applications ~- I & II by Morris and Rolph (1971); 


’ 


Statistics for Educaglon: With Data Processing by White (1973) reviewed ! 
by Wolf (1974) 5 and peatiaecel Analysis: A,Computer Oriented Approach by 
Afifi ang-Azen rN reviewed by = ews (1974). -The emphasis of Morris 
and Rolph's test is on how and when to use existing statistical teehatauan, 
The authors state that “computer use replaces theorem proving". In essence 
the pre-calculus text covers the appropriate use and sequencing of JOSS 
programs aad the, SNAP/IEDA package. The authors’ statement -indicates the 
increasing amount of statistical analysis done by researchers with @ 
— amount ap statistical experience, Packaged statistical programs 


have made this possible. 


Such negligent use of statistical packages manifests the immediate 


need for a statistical text that truely incorporates the computer's 
potential. Regretfully, Afifi and Azen's text does not satisfy this 
pressing problem. Only brief mention is made of software packages, in the 


8 .. 
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. 


first chapter of their book. The content and computational progedures 
. - sd 
of the remaining chapters closely-parallel traditional texts. Aside 


" ‘ 


from the listing of two large data sets, the book contains no computer 
output. Where convenient, the authors refer to the Biowedical (BMD) 
and Scientific Subroutine Package (SSP). 


oy 


Much to the credit of White's, textbook is the interweaving of.data . - 
° . . : i, ) 
processing into statistics. Extensive use’ of photograph&tand diagrams 
presents a through overview of computer hardware... Computer programs 
that require only a simple control card and FORTRAN format gosebticaons 
are included in the appendix. Data processing exercises in the text 
provide practice: in the use of various, statistical procedures. The data 
for the exercises is in the appendix. A oe deat jet Emphasis is pease 
upon educational examples. : a 
Probably none of the books ienttaqed taibeve would naciley the needs 
of every instructor. However, this small number of texts are among the 
. first to recognize eve interelationships of statistics .and computers. 
As long as statistical content is not sacrificed,» then experimentation 
of this type has the potential of producing significant improvements 
upon the quality of elementary statistics courses. 
* Following are guidelines for integrating statistics with computers 
in_textbooks: , ’ , e i @ 
ds Cost-ef ficiency is of prime concern in selecting a general 
IT ? statistical package vs. Vonnniad” programs. Student programping_ 
in a low level language like FORTRAN is very expensive. , ; 


2% The emphasis on computers should be on large data set manipulation 


and visual display (plotting, hist®grams, residuals). 


) 


: 


3. Simulation of data with pseudo-random computer generated numbers 


is expensive. Alternative non-computer Simulations should be 


1 7 
used where it is feasible. : F s; 
e e . wv 


4. Statistical techniques antiquated by the computer should be e 
dropped from textbooks if the techniques contribute hothing to 


; 3 : 
svatistical content eg. short-cut approximations. 


5. 1/0 of statistical programs Khould be included ih- textbooks: 
. | ; 


a 
2 aioe authora should provide iaiing readable data bases’ for : 
text and exercises. : . Z 
Following. are reasons for iipenvkaving large, statistical packages 
like BMD, SSP, SPSS, ecc. into textbooks: ” a ae a 
l. Prograas are shorter and easier ‘a writ@o"\ : , 
2. Programs usudlly work the first time. 7 
3. Typically such programs an oe results of several different 
typesyaf caleulations that a neers might not have pote . } 


to ife1ode in his own program.. 

4/ Writing programs td perform data manipulations ‘in languages Like 
FORTRAN can be tedious. , 

5. The 1/0 ne fairly uniform from one “installation to, another. 

6. Virtually all analyses are available. 

7. Most researchers publish results generated by large statistical 
packages. 

Following are reasons ios not interweaving large statistical 

packages into oGies ; % ; | a r 


, . 
1. The textbook could-not be used at the majority of Universities 


due to the large computer support system required. 


10 ss, 


I Pg : 
‘2.. Even one run of,;a program by a student is very expenfive. / 


- 3. Student fails to grasp theoretical understanding that results 


~ i 


fromwriting his own program (Abranovic,, Ageloff & Fredrick, 1974). - 


‘ » 4, Large statistical packages confuse the student with results 


— ‘that are explained in advanced courses. a! . ra 
‘ Fo} lowing are reasons for tmterweaving simple "cSned" statistical 
he Boag e 
packages into textbooks: : 
1. Unnecessary to learn a computer. Language. 
id . 
. 2. Programs require small amount.of core and can be run at most 
. t. . 
installarions. 
3. Saves class. time in teaching mechanics. ° 
ba | 
4, Programs are task specific, hence more efficient and less 
expensive to use. ; Nw 
5. Procedures for using the package could be easily taught in less 
° than two hours. e ; 
6. Provides easy access to standard techniques. 
‘ 3 | 

Following are reasons for not interweaving simple "canned" statistical 

_ packages into textbooks: | © ‘ 
1. Mindless use of statistical programs replaces the intelligent 

° : use of theory (Wallace, 1969). 


2. Canned programs can be time consuming if the data output of one 


” ‘ 


program is not compatible with input of other programs. 

3. If the data output of one program conforms to the input of 
another, then data must be stored in a more expensive form 
than for higher level, — comprehensive statistical packages 


eg. computer cards. % a 


11 


4. Canned programs are often machine dependent. 


ii ADDITIONAL TEXTBOOKS: Brier, Alan, & Robinson (1974); Dixon & Nicholson 
(1974); Hodges, Krech, & Crutchfield (1975); and Rattenbury & 


Pelletier (1974). 


Methods of Instruction by Integrating Statistics and Computers 


- 


. As we have seen, the fse of computers in statistical content has 
taken on at least two forms; emphasis on a computer language at the 
expense of statistics or vice versa. In the following discussion it will 
» become clear that the compuber can serve many facets in the process of 

statistical instruction. For convenience, the first half of this section 
will deal with published evidence of courses employing a "hands-on" 
“computer_mode of instruction (student) and courses employing a demonstra- 
lie = ’ tional computer mode of instruction (teacher). The second half of this 


’ 


section will deal with the generation and use of simulated experimental 


« 


\ ; data and iain ae non-interactive statistical packages. 
"Hands-on" 


Fe Ohe of the most all encompassing methods of "hands-on" instruction 


‘of theoretical material is Computer ‘Assisted Instruction (CAI). 


-'a- 
Oe ms 7 * | Wassertheil (1969) successfutly incorporated CAI into the laboratory 
) “ “portion of an introductory scccet linea. seine: In her study, the main 
‘ use of CAI was to {ndividualize, instruction. Each student progressed at 
>. — own pace. the computer was programmed to interact with.a student 
\ = “ata tes aie: If a student's response to a programmed corputer 


* 


ne 


question was correct the computer would go to the next question, present 


new material, skip simpler material, or go to more complex matters based 
on the previous rate of progress of the student. On the other hand, if 
the student's response was incorrect, the computer would either "present 
tutorial material, review concepts, give hints, refer to the text or tell 
the student to go home and study some more". Throughout the process, the 
computer recorded the performance of each student. All of the above 
concepts are common to CAI. 

The CAI Problem Laboratory in Statistics and STATS Workbook of 
Problems were developed by IBM's T. J. Watson Research Center in Yorktown 
Heights, New York. The workbook was used in conjunction with Alder and 
Roessler (1968). Thirteen of twenty-six students in Gonemeeheti's 
"Introductory Statistics" volunteered to schedule one hour of terminal 
fine in lieu of the usual 75 minute weekly laboratory. Wassertheil 
went over the homework problems and answered pacar 8 the control 
group in the laboratory sessions. Both groups turned in weekly assign-~‘ 
ments from the workbook. The cumulative grade ensue average ‘and exam- 


ination scores for both groups are exhibited in Table 1. 
Qe 


Table 1 ’ 
Grade Point and Examination Score Means and Standard Deviations 


of Groups in Wassertheils Study 


Non-computer | —~—S Computer 

___ grou —___£roup 

_L x a Soe 
Cumulative Average ‘ 2.53 oe 2.63 .40 
First-hourly Exam 85.2 8.9 85.7 - is 
Second Exam (multiple-choice) 81.5 18.5 84.0 9.1 
Second Exam - complete 65.9 18.0 74.9 14.2 
Final Exam (multiple choice) 62.3 124° 68.9 42:2 
Final Exam - complete 70.1 10.7 74.5 tie J 


There were no statistically significant differences between the groups on 


any of the measures. The computer group did somewhat better on the 

second examination and the final examination. The average emount of 
terminal time used to cover eight chapters was 10.1] hours with a standard 
deviation of 3.9 hours. Perhaps the most positive result of Wassertheil's 
study was that one 75 minute class period per week could be eliminated 
without deterioration of student performance. The benefit of CAI sou 
be the freeing of the instructor for individual student contact or other 
duties. 

A similar study was conducted by ForSythe and Bleich (1973). 
Twenty-five students used computer deraiuale to inceract with a CAI 
program that: 

1, Helped them learn routine material, such as definitions and basic 

processes. . 

2. Enabled each to see if he had mastered the important content of 
the text by presenting short answer questicns cad- responding to 
his replies with specific references to the text. 

3. Removed much of the drudgery of the statistics laboratory by doing 
the calculations after the student has shown that he can do them 
once. 

A great Suit of the CAI interactive program is included in thé article by 

Forsythe and Bleich. Although a control group of twenty-five students 

were randomly selected, Forsythe and Bleich did not report any comparitive 
evaluation other than that those who used the cerainals were "overwhelmingly al 


positive’. The authors concluded that "the computer ‘can be used beneficially 


to help the teaching of a 'service' statistics course. By shifting the 


14 


routine parts of the lecture and laboratory to an interactive computer 


program, we are able to increase vitae, ada extra material to the 
curriculum, while decreasing both student classroom time and total teacher 
time." 

An individualized statistics course for sociology majors (Howze, 1973) 
went a bit further in extracting the teacher from the classroom. There 
was no lecturing in Howze's course. Students worked independently at 
‘their own pace and sought the teacher's help when they encourtered diffi- 
culties. The students were explicitly told what tasks must be eongeeuea 
and the quality of performance necessary for various letter grades. The 
computer was used to generate a unique sample of data for each student's 
homework problems. Students then used the computer as an anita to 
a desk calculator to solve the homework problems. Upon turning in the 
homework a computer-generated report detailed the correct answers and key 


intermediate calculations. 


‘ 


The teaching and testing in the course was done by the computer. 
Students read assigned chapters in the text and then interacted at a terminal 
with a CAI program written in BASIC. The CAI contained both text and branch- 
ing questiong? When a student felt he was ready to take an examination, he 
logged his ID# and the computer generated and displayed on a cathode ray 
tube (CRT) 20 questions randomly sampled from a population of 100 questions. 
The student was allowed to retake an examination until he was satisfied with 
his score. No hard-copy of any examination was allowed. Of course, the 
number of retakes and scores were automatically recorded by the computer. 


Thus, the instructor could use the computer's record of the stydent's 
P y 


15 


progress as a diagnostic tool.. Howze reported only the preliminary results 


N 


of his study. There were no comparitive groups. 


Over twenty CAI programs in statistics have been reported by Lekan(1971). 


The majority of these programs were short course segments on a variety of 


specific topics written in languages that were often machine specific. An 
example, is the CAI short course on the theory and appiltrarton of the 7 
product-moment family of correlations written by Tira (1970). Tira found 
that the short course benefited students who initially had the least 
understanding of the fundamentals of statistical concepts. 

The following two studies completely incorporated the computer into 
graduate statistical service courses. The first study by Wagner and Motazed 
(1972) utilized the Proctorial System of Instruction (PSI) combined with a 
Computer-Based Support System (CBSS). PSI consists of the following 
eqmponents (Keller, 1968): 

1. Self-paced according to student's ability and time available. 

2. Demonstration of complete mastery of a unit before proceding to 

the next unit. 

3. Stress upon written communication in or eee communication. 

4. Use of lectures and demonstraticns as vehicles of motivation, rather 

than sources of critical information. 

Se Proctors provided tutoring, repeated testing, and immediate grading. 
The CBSS consisted of interactive statistical subroutines and instructional 
modules. The modules were conversational time-sharing FORTRAN programs. 

The primary topics of the modules were statistical] distributions, experi- 


mental verification of theory and methods, and data collection, analysis 


and interpretation. 
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. 

Three proctors operated the system. The proctors monitored 30 to 
40 mifiite tests taken by a student when he felt he was ready to be tested. 
Time diate grading and personal help with ies questicns were a 
functions of the proctors. Oral examinations were also a feature of this 
study. The student could not progress to the next module unless he passed , 
the proctored examination with 100% accuracy. If a student did not ee 
the course within a semester he received an "I". Another feature of PSI 
was the inclusion of five audio cassette taped lectures into the system. 

The primary purpose of the lectures was "motivational and to import the 
professor's philosophy and methods of oral communication." 

No comparitive results were gathered in the study. A student ques- 
tionnaire supported cha belied of the superiority of Wagner and Motazed's 
procedure over a "Standard" statistics course. The distribution of grades . 
in the last reported year of the study was: 10% withdrew; 85% earned A's; 
and 5% earned B's. The authors were convinced that "all students learned 
more , Sanmade wets throughly, were more satisfied, were more motivated 
and enthusiastic and overall much better trained." > 

The second study by Skavaril (1974) incorporates the computer into 
ani phases of instruction in an introductory gabvipe statistics course. 

In his study, the computer not only provided tutorial CAL support, but 
also generated statistical exercises and answers, aud® peswided subroutines 
for complete data analysis. Skavaril lists and briefly describes twenty- 
nine CAI modules, nine exercise-generating programs, and twenty-one data 
analysis programs used in his system. ‘The programs were written in IBM's 


Coursewriter III, PL/I and FORTRAN IV, and Conversational Programming System 


(CPS) respectively. ‘Usually: six half-hour meetings per quarter were required 
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ry 


for the administration of laboratory quizzes. An introduction to the 
course and computer base required four one-hour lecture periods. Otherwise, 
each student proceeded at his own ‘pace through the CAI modules. The instruc- 
tor answered questions individually. The only constraints were the announced 
dates .of examinations. All students took the same examination at the same 
time. 2 

Students accessed the modules by means of interactive, on-line mode, 
terminals, Each student was assigned an ID# which allowed the computer to 
identify that particular student and to restart the student at the last 
point worked on in a module. Students were permitted to skip or to 
repeat a module. In general siretecty, the students completed the modules in 


sequence (see Appendix B). The program kept a record on each student. The 


‘ 


record included a list of modules completed, total ‘time spent on the course, 


and performance scores on quizzes within modules. These data could only 
4 
be accessed by the instructor and were used to produce weekly reports on 


student progress. Skavaril's description of the structoring of each 
module is so clear that it is included as a model. 


"In general, each module has been constructed according to the following 
pattern. The student is first given a brief description of the modules 
content and a statement of the approximate time required to complete 

the module. The student is then asked if he wishes to work on the 
module. If the Student enters a negative response, he is informed how 
to return to the module. subsequently should he change his mind -and 
decide to take the module. If he responds that he does wish to take 

the module, the subject matter of the module is presented to the student 
in an interactive, question and answer format. Each student is supplied 
with prepared handouts to which he is required to refer from time to 
time while working within a module; The handouts are used so as to 
minimize the amount of typing done by the computer terminal. During the 
presentation of the module's instructional material, wrong answer 
processing is employed in a diagnostic manner in order to inform the: 
student why a particular response was incorrect. Frequently, through- 
out each module, the student is given the option to receive additional 


\ 
\ 
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, 


\ 

* instructional material in the® form of supplementary and complimentary 
material and numerical examples. After the instructional material has 
been presénted, .the student is assigned his laboratory work for the . 
module and told which of the CPS programs are relevant for the particu- 
lar analysis’ at hand. Next, the student is informed as to which chap- 
ters in the text (Li, 1968) contain related material. Then, the 
student has the option of working practice problems and answering 
review-type questions and/or taking an optional quiz. After completing ’ 
the quiz, the quiz score is presented together with a statement of the 
instructor’s evaluation of that score. The correct answer for.each 
quiz question incorrectly answered is also displayed. Throughout. all 
modules, the student is allowed use of the "calc" command for miscel- 
laneous computations". 


Skavaril compared the time expended and examination —- for the computer 
based group with a conventional lecture-laboratory group for the same course. 
The results are presented in Tables 2 and 3. 

Table 2 


Average Total "in-class" Hours 


Activity ~~~ +Computer-Based —— ~~ Lecture-Laboratory i 
_ : (70 Students) - (50 Students) 

Lecture Bed 32.8 

Laboratory 3.0 20.0 

CAL 21.7 0.0 

CPS 8.0 0.0 

Exams ___ 34 aoa 

Total Hours 39.3 56.2 

i a ee 

Table 3 


Comparison of Final Examination Scores 


Statistic ‘ Computer-Based Lecture~Laboratory 
n (70 Students) 450 Students) 
Sample mean 60/100 6 57/7100 | 
Sample variance 270.68 363.32 
Standard error 1.97 2.69 
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Clearly, a great deal of time was saved at no expense to learning as ‘° 


2 e e 
measured by the final examination. In addition, the author notes that 


te exercise-generating and CPS programs, provide additional gains, since 
the student recéivés a unique set of data; cribbing is eliminated. Freeing 


~—., 


tfe student of thé tecium of calculations allows him to analyze several 


sets of data and "te build, by comparing statistics between analyses, 
: : / 8 a. 
empirical evidence concerning the underlying distribution of those statis- 


' 


ties.” , . 3 
Demonstrational 


In essence, this section simply questions to what extent student 
involvement with the computer is cost-efficient in the teaching of an 
elementary statiscics course. For exauple, is it necessary that every 
student individually stitaces the Central Limit Theorem, or individually 
simulates the meaning of "5%"" statistical significance by repeating an 
experiment 100 times on the computer as described earlier in Bulgren's 
supplementary textbook? Filming or video taping these computer simulations 
could provide the same learning at far less cost. Another question is, 
how cost-efficient is it to generate unique data sets for each individual's 
homework problem? Is the generation of such data sets to benefit the 
student or simply to assure the instructor that each individual completed 
his own work? These questions truly relate to the merits of the statistical 
laboratory. 

Each of the studies thus far described in this article appeared to 
develop from the desire to eliminate distracting computatiens from statistics 


courses. Previously, these laborious tasks were relegated to the statistical 


20 


19 


laboratory. The computer has been offered as the computational genie for 
both student and instructor. And thus, more often than not, the computer 
has been introduced and utilized in the statistical laboratory. : aa s 
Considering the evolution of the computer in the last twenty years, 
it is obvious that computers initially were viewed as sophisticated calcu- 
lators and thus their proper place was in the laboratory situation. In 


%. 


manyinstances the laboratcry was viewed simply as problem sessions. Now 


that computers are more flexible ard diverse in capability, their use 
< 
should be objectively incorporated into the lecture and laboratory situation. 


That is, the appropriate use of computers in a course occur® when the 


objéctives of the lecture and laboratory are re-examined in terms of the- 
a mS ' 


posdible contributions of the computer. 

Certainly, a student's ability to add, multiply, and-divide on a 
desk calculator is not the main objective of a traditional statistical 
laboratory situation. In the same way, a student's ability to push buttons 
On a console or type a program name on a teletype and then slavishly follow 
a set of directions in order to receive a few numbers or to progress to the 
next question that a proctor already has the print-out of, is not the 
objective of a statistical course. A programmed text with solved problems 
would be far less expensive. Instructor controlled computer usage to meet 
specific course objectives could control the costs. 

The instructor can do many things with the computer to provide useful 
information for the statistics classroom or laboratory. A compiled set of 
statistical problems with computer solutions eliminates expensive student 
use of the computer and unnecessary learning of the mechanics of programming. - 


Computer graphing of theoretical distributions, pupulations, samples, or ‘ 
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transformations can easily be compiled into booklet form available for 


student purusal. Wegmag and Gere (1972) produced a workbook of problems 
with computer solutions and a set of forty slides illustrating a variety 


. 


‘Of distributions, densities, and histograms available at cost. 


Many recent innovations have increased the availability of computers 


\ 
for in-class demonstrations and experiments. Minicomputers, phone line 
teletype, and video hookups, hard-copy off of CRT's, and kinescope projection 


provide the instructor with-the option of using the computer in class as a 


~ 


supplement to the lecture. Recent articles by Edgell, Lehman, Starr, and 
Young (1975), Kanji (1974) Tanis (1973), and Abranovic, Ageloff, and 

' ° 
Fredrick (1972) offer a large number cf methods for: the use of the computer 
or simulating equipment as supplements to a course in statistics. An 
innovative method of discussing and using the Poisson distribution follows 
(Wegman and Geré, $972): 7. 8 “ 


"Instructor A purchased two bags of chocolate chip cookies, both were 
the same brand but on one bag there was a large seal proclaiming 'more 
chips'. The students received one cookie from each bag and were asked 
to gdunt the number of chips. (The students were allowed to dispose of 
the residue as vhey deemed fit.) The results were tabutatéd and tables 
of the Poisson distribution were calculated using an APL terminal. The 
results were duplicated (mimeographed) for student use. The students 
were asked: : 3 

1. Whether the distribution of chips seemed to fit a Poisson. 

2. Whether the results from the two bags of cookies seemed to 

indicate a difference between, the two. 

. Whether the results of either bag conformed to the manufacturer's 
national advertising, claiming an average of sixteen chips per 
cookie. * e . ‘ 

_ With this history, we see two aspects of the computer use in an elementary 
course. Firstly it serves in a demonstration mode and secondly its 
speed and accuracy allowed Instructor A to compile materials based on an 
actual in-class experiment." 


The computer has its rightful place in the instruction of statistics. 


It is not only important that the instructor make thoughtful use of the 
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computer; it is also important, that student use of the computer be thought- 


fully arranged by the instructor. . 


"Some of the reasons to use computers ,to aid in learning or teaching. 
A 


statistics are as follows (Andrews, 1973):° 


La Goneueart are among the tools of the practicing statistician. 
. , va Calculations’ are fast and typically if one set correct the 
remaining sets are also correct. + Rh 
3. Data in large quantities may be feasibly stored and organized. 
4. Computers may be used as "teaching machines" for factual information. 
5, Computers are fun; they can enliven’ some aspects of a problem. 
Some of the reasons not to use computers to aid in learning or 
“teaching saviecies are as follows (Andrews, 1973): 
1. ‘No aoney is available to finance extensive computing by students. 
r ye the available computer is inadequate or inefficiently operated. 


3. The available software is inadequate. 
; hii Coasunate take longer than hand calculations. ae“ f ; 
; 5.°The student should not become actewden or machine dependent. 
6. 95% of computer output is useless, and 99% of cowputer output is 
tedious to read. 
7. Computers create a barrier between students and data. Gross 


‘ 
errors result. 


- , ‘ x 
8. Students may confuse computing with analysis. 


‘ 
/ 


Simulation 


. Not only can the computer eliminate the tedium of computations, it , ; 


r) : ges ; 
ca can also eliminate the collection, input, storage, and manipulation of data. 
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A computer can be a fancy random! number. generator. Statistical designs can 

be specified for pppiletiees of known parameters, Foljowing is a discussion 
of some of the more recently reported simulation piugneee STEXSIM, developed 
by W. Thomas (1972) in FORTRAN generates data for factorial designs having 

up to seven random or fixed main effects. Lehman's (1973) programs generate 
data for "single-variable independent~group designs, generalized analysis of 
variance designs, ... for both bivariate and multivariate experiments". The 
programs were, written in FORTRAN. Salmon and Tracy (1975) developed four 


» 
programs that generate exercises on z~scores, Pearson product moment-€orrela- 


tion with regression or matched groups t-test, independent groups t-test, 
and chi square. The scatihd exercises consist of generated dete. and problem 
instructions. A solution corresponding to the exercise is produced for the 
instructor. ‘Intermediate steps in.the solution are included. To generate 
exercises, the instructor enters such information as the number of exercises 
to be produced, the difficulty level of the exercises, and the parameters of 
the population into the appropriate program. The programs were written in 
BASIC. A similar package of four modules was written by D. Thomas (1971). 
Entitled STATSIM, these modules were designed for terminal use. The exercises 
relate to a and inferential statistics for chi Square, t-, z-, and 
F-distributions. 

An extensive data generation system, EXPERSIM (Main, 1971), is a set af 
sophisticated computer simulation models for various experimental situations 
in specific subject areas, <g. imprinting, drug research, motivation. Each 
simulation includes a complete description of the experimental setting, built 


in controls, number of variables that can be manipulated, and the sample data. 


The student may then analyze the experimental data by requesting statistical 
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routines, EXPERSIM was written in FORTRAN. Exxon Education Foundation is 

offering grants to J pebewttons desiring to implement the system. In fact, 

each of the simulation programs discussed in this section are available 

Crean the coppenttve authors. 

A cBuprehensive aesohie display system was developed by Beaujon (1970). 

” @uupaier generated graphic and alphanumeric information can be displayed on 

an IBM 2250 CRT. The eyaten can simultaneously display the probability 

density function, cumulative dintititton function, or frequency distribution 

of a random sample from any of the sotiweiee distributions: discrete uniform, 


binomial, poisson, hypergeometric, continuous uniform, triangular, normal, 


: Bie oss , 
» gamma, exponential, Cauchy, beta, Student's t, chi square, and F. 
Using Beaujon's display system, Wegman (1974) projected 28 slides 
illustrating various distributions to 18 introductory statistics students 


two days prior to their third examination in the course. The 19 minute slide 


° 4 


uA 
show was "accompanied by a simp¥e description of the slides". The 18 


control students were called in for the remaining 75 minute review, question 
and answer session. The material Wegman reviewed included a discussion of 


the properties of the distributions, just-shown the "slide group" as well as 
Pg “ S 7 Ps : ° a 
other mdterial relevant to the upcoming examination. A ten-question true- 
= ose ‘ 
‘ ‘ s ’ 
‘false quiz was inciuded in the third examination and final examination. 


‘ 


Wegman found that "a very modest amount of supplementary graphical material 


of the type made available by the graphic display packages provides a 


significant (p&.005) increased score for a short term." ° 
Following: are suggested '(Andrews , 1973) ways for using a system of 
statistical packages.’ Bn ass 


‘lV Data collection, and handling. Basic operations such as sorting 


na 
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or, listing .can aid in the preparation and distribution of examples. 


=a es te ' Data may be given to students on cards ready for further computation. 
4 2. Data plotting: histograms, scatter plots. For large data sets, this 
* plotting is eased considerably by the use of computers. — 
. . 3. Computations which are part of a more refined analysis, eg. analysis 
i . + of variance. , i 


4. The above: may be done by the teacher’or by the students. 
5. Very, very rarely, the computer may be used to generate pseudo~ 
‘ .Wandom data for subsequent analysis’ (recycling in the “garbage in 
garbage out" principle). Such data are useful’ for illustrating the 
_ properties of a particular technique; they do not illustrate many ‘ 
an of the problems of less idealized situations. 
ADDITIONAL REFERENCES: Cassel, 1971; Dixon, 1971; Fachnie and Schillace, 
y] = & % t 
‘1973; Finn, 1971; Michael, 1973; Spirer, 1972. 


Interactive ys. Non-interactive Statistical Packages - 


ws t ts 
Large statistical packages such as BMD (Biomedical; Dixon, 1968), 


- 


IMSL (International Mathematical and. Statistica] Language, 1975), SAS 
(Statistical Analysis Systém; Barr and Goodnight; 1972), and SPSS (Statisti- 


7 cal Package for the Social Sciences; Nie, Bent, ard Hull, 1970) are prphibi- 


tively expensive (core and external device requircuents) for student use 


ae ; ‘in introductory statistics courses. .The amount of core -and the use of disk 
r s . ‘ . ~ 
and magnetic tape- rapidly increases the cdst of processing such packages. 


- . . - 
wt Sw Smaller packages have been developéd. MINilAb (Ryan and Joiner, 1973) 
. ' a . w ‘ 
and OMNISHRIMP (Harris, Swanson, and Duerr, 1974) have supplante? the much 


slower. OMNITAB (Swanson, Ledlow, and Harr#s, 1973). Both are smaller, faster 


systems which run on medium sized:’computars:, These packages are usually 
‘3 "batch" processed. ‘ 
: ae . 


A recent release by Koh (1975) of TUSTAT-II (Tutorial System for statis- 


tics with time-sharing computers) and STRAP-II (Statistics system for research 
and production with time-sharing computers) provides 140 statistical routines - 

° Tea Bs 
in BASIC. Each source program requires less than 4K words. The utility of 


a 26” . 


koh's programs is clear in his reflection that 


“usually regearchers who are comparatively naive in statistics or 
computer knowledge complain the most. After carefully observing all 
possible aspects of interactions between consultees and consultants, 

I began to see that the time-sharing terminal and a sophisticated 
statistics system such as STRAP would reduce some of the communication 
g4ps and complaints. By letting the research scientists do some of 
their own simple statistical analysis themselves, they begin to under- 
stand what kind of work there is to be done to get statistical analysis. 
Also, the STRAP users are willing to spend their own time at the terminal 
to get instant response instead of asking their consultant." 


Another at statistical package is STP (Statpack; Houchard, 1974). 


Written in FORTRAN, the package has 16 overlays. It is an integrated, inter- 
achive, package written for terminal use. STP allows the user to issue simple 
commands for data analysis and*it will prompt him for necessary information. 


When questions of a procedural nature arise, the user may ask for an addition- 


al explanation by typing "HELP". The standard output device is the terminal, 
but output may be channeled to the line printer. STP is unique in that you 
miy issue a command to store -your data on disk or tape., You could then 


"read” it oue of storage and manipulate it in core at 50m latter date. 


e - 


The statistical packages mentioned briefly in this section have not 
been evaluated in form or substance. The Statistical Computing Section of 
the American Statistical Association is currently studying strengths and 
weaknesses of statistical programs within packages. But, over-and-above the 
calculations within a statistical analysis are the sequencing of svaktetical 
analyses. | This dimension of a statistical package may be considered to be 
the degreg in which the computing is tnteractive, ie. the number of times 
the analyse dhrects the computation. Andrews (1973) suggests the following 
Carrere for a non-interactive package: 


1. These are typically very similar to subroutines and thus require 
little introduction for the FORTRAN programmer. 
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2. They require no change in the existing hardware if computer core is 


’ 
» 


large enough. ’ = 

3. The output is typically voluminous bringing many things to the 
attention of the analyst. 

4. The output is standard to other users of the same programs. Hence 
it is easily read by others. > 

5. The programs are standard, hence the calculations are more likely 
to be trusted by others. 

6. To analyze output requires time and thought. There is little or no 
time advantage in using an interactive system if there is an efficient 
method of running standard jobs. 

7. Interactive systems require sufficient hardware and software to 
support some sort of time sharing system. This may not be available. 


Considerations for using interactive systems. 

1. The analysis of data is interactive! Interactive computing reduces 
the time required for this interactive process. 

2. Interactive systems provide greater flexibility in analysis. 

3. They bring the analyst and data closer together so the analyst has 
a better "feel" for the data. 

4. Output typically is brief ‘presenting primarily what was asked for. 
It raises few (perhaps extraneous) questions for the user. 


5. The interactive system can guide the investigator through the 
analysis and may help to prevent gross errors. ~ 


CONCLUSION 


The computer has progressed from a simple calculator to a sophisticated 
interactive device capable of instruction. The eee of inexpensive, 
programmable computers has“nad and will continue to have a truely great 
influence on the development of statistical theory, practice, and teaching. 
But, the succemnful introduction of computers into a statistics course will 
occur only when the objectives of the course are re-examined in — of the 
possible contributions of the computer. For if computer usage is not aimed 
directly at fulfilling course objectives, then it is highly probable that the 
use of the computer will be inefficient and impractically high priced. Thus, 
it is not only important that the instructor make thoughtful use of the com- 


puter, it i also important that student use be thdughtfully arranged by the 
be tasae } 
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APPENDIX A 
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Exercise 5.1 


Statement of the Problem. Prepare and execute a program that will take a random 
sample of n observations from a population which is N(10,100). Let us pretend that 
the population mean is unknown. Using the 5% confidence coefficient, compute two 
confidence intervals for yw (the population mean). In the first, compute the 
contidence interval assuming o? is known, and im the second, compute the 
contidence interval assuming o* is unknown, that is, just replace o? wy the sample 
variance, Repeat the above experiment N umes. Tabulate the number of times the 
population mean yw = 10 falls within the calculated intervals. 


Miput. Test vour program with the following sets of input values. 


DataSet 1 Data Set 2 


n= 10 n= 40 
N = 100 N = 100 


" 


Output. Your program should output the number of times the population mean yu 
tally within the calculated intervals, the sample mean and variance for each of the N 
-experiments, and the total sample mean and variance 


Discussion and Questions, Vhe purpose of this exercise is threefold. First, the 
exercise is to show that in repeated sampling, the population mean will fall in 
95% = (100- 5)" of the calculated 5% confidence intervals. Second, when the 
population variance is unknown and when the sample size is large, we can rely 
heavily on the high degree of probability (confidence coefficient) established prior 
to the running of the experiment. Third, as the sample size increases within cach 
experiment, the better are the point estimates x and s? of w and o?, respectively. As 
a guideline, n should be greater than 30 for this approximayon to be valid 


1. For each data set and o? known, how does the tabulated number of times the 
population mean yw falls within the calculated interval compare with the 
theoretical result, that is, N X .95? 

2. For each data set and o? unknown, how does the tabulated number of times the 
population mean yw falls within the calculated interval compare with the 
theovctical result, that is, NX .95? 

3. How'do the-answers to Questions 1 and 2 compare? What is the consequence of 
increasing the sample size without changing the confidence coefficient? 


5 


4. What would be the effect if we reduced the confidence coefficient to 1%? 
What is the consequence of using zero percent confidence coefficient? 


wn 


6. What is the advantage of having a large sample if determining the confidence 
interval of a population mean? Iustrate your answer with the output of your 
computer experiment. 

7. Why do the lengths of the confidence intervals ofa population, mean chinge 

‘ from sample to sample even if the sample size remaihs the same? 

8. Regardless of the sample size, one can obtain a confidence interval Why does 

one prefer a large sample?-Comment about your point estimates of » and 0? 
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1. 29 modules of computer assisted instruction in a 
course named ‘gen6S0’. 
2. 9 types of exercise-generating programs. 


3. 21 CPS analysis programs. 


4. Various programs supplied by the central ad- 
ministration of the University. 


APPENDIX B 


__ RUSSELL V, SKAVARIL ; 


Computer Assisted Instruction Modules 


Each of the 29 computer assisted instruction modules 
has been given.a name which is the program label 
used by the students Jo access the module. The labels 
used and a brief description of the computer assisted 
instruction modules are shown in Table 1. 


Table 1. Computer Assisted Instruction Modules . ; 
So SSE SESS  _ = _SSSS=== SS 
LABEL CAI UNIT LABEL CAI UNIT 
regsta Preliminary instruction on some CAI system civar Confidence intervals for the variance of a 
features: signal for student response, use of the normal distribution by means of the chi-square 
go to command, use of the cale feature, com- distribution. 
ments to the author, and the notational system 
used in the course, {dist F distribution and test of the equality of two 
population variances, 
normds The normal distribution and the parameters 
a3 and a4. apsta’ Unpaired f tests. Test of the hypothesis that 
the means of two populations are equal. 
stnmds °The standard normal distribution. 
ptt Paired (tests. Test of the hypothesis that two 
revb Review of some topics needed before taking a population means are equal based on paired 
unit on the Central Limit Theorem. observations. 
clt Central Limit Theorem. anovai One-way analysis of variance. 
i Quiz concerning some aspects of Central Limit pbsowa Practice problems and review questions con- 
Theorem ~ some practice problems. cerning the one-way analysis of variance. 
splst Review on population parameters and a unit coding Effects of coding operations on sample mean 
on sample statistics as calculated in Laboratory and sample variance. 
Problem Set 1. 
sxpval Expected values through the one-way analysis 
dea Hypothesis testing with special reference to of variance and including practice problems. 
decisions and their outcomes, Type I and Type ‘ , 
Ui errors. anova2 Two-way analysis of variance. 
ztest Test of null hypothesis that mean of a normal reg Single variable, linear regression. 
. . distribution equals some specified value by 
means of the Z test. regqus Practice-problems and review questions on the 
topic of single variable, linear regression. 
tdist Use of ¢ distribution to test the hypothesis 
that population mean equals some specified cor Correlation. 
value. 
. meansp Mean separation procedures. Least Significant 
cimu —_ Confidence intervals for the mean of a normal Difference and Duncan's Multiple Range. 
population by means of the f distribution. 
beta Probability of Type II errors in Z test of 
cimucx Some practice problems involving the use of Ho: p= He 
the f distribution to calculate confidence inter- ‘ 
vals for the mean of a normal population. -reldis Relationships between theoretical distributions 
(Z,¢, chi-square, and F distributions). 
chisq = The chi-square distribution. 7 
4 
chivar The use of the chi-square distribution to test : 


the null hypothesis that the variance of a 


normal distribution equals some specified value. 


Dd : . 
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Table 2. Exercise Generating Programs ‘ . 

Program i * Program ° ? 
. Name . Description Name \ Description 


LP1B_ Finite populations. 


LP1A_ Exercises concerning the normal distribution. 


LP1 Single sample statistics and analyses, descriptive’. 


statistics involving sample mean and sample 
variance, tests of hypotheses about mean and 
variance. This program also produces a data 
base used for the analysis of variance exer- 
cises. 


LP19B One-way analysis of variance, equal replication. 


~ LP20A - One-way analysis of variance, unequal repli- 


cation. ; 


: LP21B. Two-way analysis of variance, single observa- 


tion per cell. 
LP18 Linear regression. 
" LP11A_ Least Significant Difference. 


-LP11B Duncan's Multiple Range. 


Table 3. Statistical Analysis Programs 


* Name Description 


LP1.1 Items (1) through (10) in Laboratory Problem 
Set 1, sample statistics. 


P2.1 Sampie mean and related statistics. 


Pl.l All of Laboratory Problem Set 1B, calculation 
of population parameters. 


P3.1 Laboratory Problem Set 1A, probabilities for 
normal variates ; 


P4A.1 Testof Hg: w= bo 


P4B.1 Confidence intervals for p. Input data include 
all the observations in a sample. ‘ 


P4B.12 Confidence intervals for. Input data are 
sample mean, standard error, and { value. This 
program may be used to compute Items (13) 
through (16) in Laboratory Problem Set 1. 


P5.1 Test of equality of two population variances 
by F tert. 


P6A.1 Test of the difference between two population 
means by f test for unpaired observations. 


P6B.1 Test of the difference between two population 
means by f test for paired observations. 


P7A.1 Confidence interval for o?. Input data include 
all the observations in a sample. 


P7A.12 Confidence intervals for o?. Input data are 
corrected sum of squares and the two chi- 
square values. This program may be used to 
compute Items (17) through (20) in Laboratory 
Problem Sct 1. 


Program 
Name Description 


P7C.1_ Analysis of a 2 x 2 contingency table. 


CODING This program may be sed to code a set of | 


variates, XxX}. sy X; Sivas ae to Y). Perr Y; ‘ 


s+ Y5 by the operation 


a 


Y; = AX; +B 


in which A and B are constants. This program. 
may be used to produce the coded data for 
LP19C and LP19E. 


P8.1 One-way analysis of variance. This program 
may be used for Laboratory Problem Sets 19B, 
19C, 19D, 19E, and 20A. 


P9A.1_ Linear regression. The data are entered in 
“bivariate form,” that is, (X). Y7)..... X;. Y). 
sis Ras Yh 


P9A.12 Linear regression and test for linearity. This 
Program can be used for LP18B. The data are 
entered in “array form," that is, Ap Xp Yop 


ese Ying: dove Nb Xp Yup sees Yin: 
P9B.1 Correlation. 


P10.1 Two-way analysis of variance. This program 
can be used for Laboratory Problem Sct 21B. 


P11A.1 Least Significant Difference. This program 
can be used for Laboratory Problem Set 11A. 


P11B.1 Duncan's Multiple Range. This program can be 
used for Laboratory Problem Set 11B. —~ 


va . 
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